HPC in a HEP lab: lessons learned from setting up cost-effective HPC clusters
نویسندگان
چکیده
منابع مشابه
Productivity in HPC Clusters
This presentation discusses HPC productivity in terms of: (1) effective architectures, (2) parallel programming models, and (3) applications development tools. The demands placed on HPC by owners and users of systems ranging from public research laboratories to private scientific and engineering companies enrich the topic with many competing technologies and approaches. Rather than expecting to...
متن کاملNetwork Performance in Distributed HPC Clusters
Linux-based clusters have become prevalent as a foundation for High Performance Computing (HPC) systems. As these clusters become more affordable and available, and with the emergence of high speed networks, it is becoming more feasible to create HPC grids consisting of multiple clusters. One of the attractions of such grids is the potential to scale applications across the various clusters. Th...
متن کاملScheduling MapReduce Jobs in HPC Clusters
MapReduce (MR) has become a de facto standard for largescale data analysis. Moreover, it has also attracted the attention of the HPC community due to its simplicity, efficiency and highly scalable parallel model. However, MR implementations present some issues that may complicate its execution in existing HPC clusters, specially concerning the job submission. While on MR there are no strict par...
متن کاملRNS: Remote Node Selection for HPC Clusters
Scalability of distributed high performance computing clusters in different administrative domains is critically dependent on the deployment of a proper resource discovery mechanism that can discover resources residing in different wide administrative domains. In this paper, we present a new method for remote cluster node selection called RNS that such a required resource discovery mechanism ma...
متن کاملLinux-based virtualization for HPC clusters
There has been an increasing interest into virtualization in the HPC community, as it would allow to easily and efficiently share computing resources between users, and provide a simple solution to checkpointing. However, virtualization raises a number of interesting questions, on performance and overhead, of course, but also on the fairness of the sharing. In this work, we evaluate the suitabi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Physics: Conference Series
سال: 2015
ISSN: 1742-6588,1742-6596
DOI: 10.1088/1742-6596/664/9/092012